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Abstract. - Temperature chaos is an extreme sensitivity of the equilibrium state to a change 
of temperature. It arises in several disordered systems that are described by the so called 
scaling theory of spin glasses, while it seems to be absent in mean field models. We consider 
a model spin glass on a tree and show that although it has mean field behavior with replica 
symmetry breaking, it manifestly has "strong" temperature chaos. We also show why chaos 
appears only very slowly with system size. 



Introduction. - The fragility of the equilibrium state to an infinitesimal change of tem- 
perature is commonly referred to as "temperature chaos" jlj]. Having such fragility away 
from a phase transition point probably requires the system to be frustrated, but whether 
temperature chaos actually arises in generic frustrated systems is still subject to controversy. 
In the context of spin glasses [|[ || , temperature chaos is shown to be present for models on 
Migdal-Kadanoff lattices Furthermore, the standard scaling theories f|,[l], suggest 

that this is a general property of glassy systems; in support of this, the Directed Polymer 
in a Random Medium || (DPRM), which is well described by the (spin glass) scaling the- 
ories, is known to have temperature chaos H[h]]. On the other hand, the Random Energy 
Model has no temperature chaos and what happens in the Sherrington-Kirkpatrick 
(SK) mean-field model of spin glasses is still unclear. A replica calculation for the SK model 
suggests the presence of temperature chaos , but the numerics indicate no chaos or only 



very weak chaos |13, L4,15[. Furthermore, a more recent calculation by Rizzo |£6[ shows that 
temperature chaos is absent in perturbation theory about the critical temperature T c to the 
orders computed. To clarify this question of temperature chaos in mean-field spin glasses, in 
this paper we study a specific mean-field-like model. By determining the probability density 
of overlaps for two real replicas at two different temperatures, we show that this model has 
temperature chaos even though it has a mean field behavior with replica symmetry breaking. 
Our quantitative study also gives a coherent picture of chaos and suggests why chaos is so 
weak in general. 
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The model based on a tree. - In this paper, we focus on the model introduced in ref. Jl7|| . 
It is very similar to the model of a polymer on a disordered Cayley tree studied by Derrida 



and Spohn |18| (see also |19LG0I]); the differences are that values of both energy and entropy 



are assigned to each branch of the tree and each state thus has extensive entropy. It is also 



close to the Random-entropy Random-energy model |21|; however, the energies and entropies 
are assigned hierarchically and the entropy is not introduced in an ad-hoc way. 

The model is constructed as follows. We consider a Cayley tree rooted at O. Each branch 
point B (including O) creates K branches which connect B to its descendants. A tree with 
L generations is obtained by repeating this procedure L times. We regard the leaves (the 
bottom points) of the tree as the states of the system. A tree with L generations has K L 
states. A random energy e and a random entropy a are associated with every branch of the 
tree. The variables e (respectively a) are drawn independently from the same distribution 
/Ob(e) (ps(o~)). The energy E{B) (entropy S(B)) of a branch point B is given by summing 
up the e's (cr's) of the branches which lie along the path connecting it to O. This means that 
the values of energy and entropy are correlated hierarchically. The distance dij of two states 
i and j is d [d = 0, 1, . . . , L) if their first common ancestor arises on the ci-th layer counted 
from below. The overlap is related to dij by qij = 1 — dij/L, where L is the number of 
generations of the tree. 

Note that our model is mapped onto Derrida and Spohn's model if we set p%(e') = 
J dedo~5(e' — e + To~)pE(e)ps{a). Therefore, we can use the results in ref. [l8| whenever we 
consider observables which depend on just one temperature. (Of course the concern of this 
paper is almost exclusively observables associated with two temperatures.) A consequence of 
this mapping is that our model has a critical temperature T c below which it exhibits one step 
replica symmetry breaking (RSB): when T < T c , the distribution of overlaps consists of two 
delta function peaks, one at and one at 1. 

Derivation of the overlap distribution with two different temperatures. - To study tem- 
perature chaos in this model, consider a given realization of the quenched disorder (the random 
energies and entropies); for that disorder, introduce two real replicas at equilibrium, one at 
temperature T and the other at temperature T", both temperatures being below T c . Of in- 
terest is the probability distribution of the overlap of these two replicas. We want to know 
how this distribution depends on L and on the temperatures. We thus calculate the disorder 
averaged "integrated probability" to find the two replicas at a distance less or equal to d. This 
probability is explicitly defined as 



In this expression, 7TT represents the disorder average, Xt{%) = E(i)/T — S(i) is the free- 
energy divided by T of state i, and Zt{L) is the partition function at temperature T for L 
generations. Using an integral representation of 1/x for the two quantities Zt(L) and Z' T {L) 1 
we can rewrite eq. (Q) as 

dudvF TT '(L,d-u,v), (2) 

OO 



F TT ,{L,d;u,v) =exp[-e-"Z T (£) -e~ v Z T >(L) -u-v] V e -x T (i)-X T ,(j) _ r 3 \ 

^— 'y/d»j<d 

We can use Y, ij/dij <d exp[-Xr(») - X T . (j)} = £ Sd exp[~X T (B d ) - X T , (B d )}z T (B d )z T , (B d ), 
where B d is a general branch point in the ci-th layer (counted from below) and zt{B) is the 
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partition function at T of the sub-tree rooted at a branch point B, in order to obtain 



F T T>(L,d;u,v) = exp[-e- u Z T {L) - e-"Z T >{L) -u-v] 
x 



;V e X p[-X T (B d ) - X T ,(B d )]z T (B d )z T '{B d ). (4) 
From this equation, we find 

F TT > (d, d: u, v) = H T T' (d;l,l;u,v), (5) 



H TT <(d;m,n;u,v) = [e-^z T {B d )] m [e- v z T ,{B d )] n exp [-e^z T {B d ) - e- v z T .{B d )]. (6) 

We can calculate Htt' (d; m, n; u, v) (including Htt> {d;l,l;u, v) which appears in eq. ([5])) 
by the following recursion formulae. For m = n = 0, it is not so difficult to find 

H TT ,(0;0,0;u,v) = exp^e" 11 - e~ v ], (7) 
H TT >(d+l;0,0;u,v) = H TT > (d; 0, 0; u, v) K , (8) 

where for a general two variable function g(u, v), we have defined 

g(u,v) = J ded<Tp E (e)p s (a)g(u + e/T - a,v + e/T' - a). (9) 
The recursion formula for general m and n is derived by applying the relation 

Htt* (d; m, n; u, v) = q-^q^ H tt> (d; 0, 0; u, v) (10) 
to eqs. (0) and (||). For example, the recursion formula for HrT'{d; 1, 0; u, v) is 

H TT ,(d+l;l,0;u,v) = ^-H TT ,{d; 0, 0; u, v) K 

ou 

= KH TT ,(d;l,0- 1 u,v)H T T'{d;0,0;u,v) K - 1 . (11) 

Finally, a method similar to the one used in ref. |l7|] leads us to 

F TT ,{L + l,d;u,v) = KF T T'(L,d;u,v)H TTf (L;0,0;u,v) K - 1 {L>d). (12) 

In summary, the disorder averaged distribution of distances YrT'{L,d) can be computed 
by the following procedure: (i) Calculate HTT'(d; 1, l;u,v) (=FTT'(d,d;u,v)) by evaluating 
numerically the recursions which are derived by applying eq. ( |l0| ) to eqs. and (||). (ii) Cal- 
culate Ftt 1 (L, d; u, v) by using the recursion eq. 
numerically the integral in eq. (S. 



13). (iii) Compute Ytt'(L, d) by estimating 



Temperature chaos. - To show that this model has temperature chaos, let us first measure 
Ytt'(L, d = 0) = J2i -fT q (*)^r^(*)' wnere -PtH*) = ex P[ — Xt{i)}/Zt- This is a generalization 
of X^I-PtK*)} 2 which has been studied in many systems like the SK model j22| and the 
Random Energy Model The result is shown in Fig. || (A). We used K = 2, pe(^) = 

0.255(e) + 0.5<5(e - 1) + 0.256(e - 2) and Ps (a) = 0.55(a) + 0.5S(a - 4) for those data. The 
critical temperature T c is around 1.63 by the mapping to the Derrida-Spohn model and using 
the corresponding formula in jl8). We see that Ytt' {L, d = 0) decays exponentially for T =/= T' 
while it converges to a non-zero value for T = T'. (More precisely, a fit of the data at large L 
gives Y TT <(L,d = 0) « AL^ 1 / 2 cxp(— BL).) These results tell us that the partition function 
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Fig. 1 - (A) Y TT ,(L, d= 0) vs. L for (T, T') = (0.33,0.2), (0.2,0.2) and (0.33,0.33). The parameters 
for these data are K = 2, p E (e) = 0.25<$(e)+0.5<5(e-l) + 0.25<S(e-2) and p s (cr) = 0.5<5(ct)+0.55(ct-4). 
The critical temperature T c is around 1.63. (B) Y TT ,{L, (1 - q)L) for (T, T') = (0.33,0.2) vs. qL. 
The data are taken for q — 0.2, 0.4, 0.6, 0.8 and 1.0 with the same parameters as before. 

below T c is dominated by a few states, but these dominant states change with temperature, i.e., 
there is temperature chaos. We have also checked that temperature chaos is absent in the 
model without entropy (no ps(o~)); this is in agreement with ref. |fl2f which shows that the 
GREM does not have temperature chaos. Ref. also has shown that there is chaos against 
magnetic field in the GREM. But this result is not so surprising if one notices that the energy 
of state i under field H is E{i) — HM{i) (M(i) is the magnetization of state i), and field plays 
the same role as temperature in our model. 

The quantity YxT'{L,d ~ 0) decays "very fast", in fact exponentially with L, not as a 
stretched exponential or as a power of L. This suggests that the overlap probability distri- 
bution itself decays exponentially to zero for non-zero overlaps; to check this, we now study 
YrT'(L,d). Interestingly, it turns out that YrT'(L,d) satisfies the scaling law 

Y TT > (L, d) w Y TT > (L - d) (13) 

for large L and d. To show this, first rewrite eq. (0) as 



( )= E Bd exp[-X T (i? d ) - Sf T (B d ) - X T ,{B d ) - 5f T >(B d )\ 
TT ' [ ' ' T.B d ,B'^[- x T{B d )-5f T {B d )-X TI {B' d )-5f T ,{B' d )Y [ > 



where 8fT{B d ) = — log[zT(B d )] + log[zr(B d )]. Derrida and Spohn |18j] prove that Sfr(B d ) 
has a limiting distribution that has a finite variance as d — > oo. Furthermore, the statistics of 
XT(B d ) only depend on L — d. These facts lead us to the scaling law eq. jl3[). 

The validity of eq. ( [l3|) is confirmed in Fig. [I] (B) where Ytt>(L, (1 — q)L) for q = 
0.2,0.4,0.6,0.8 and 1.0 is plotted as a function of qL. Notice that Ytt'(L, (1 — q)L) is the 
probability that the overlap of the two replicas is larger than q. The data, except those 
for q = 1, satisfy the scaling very well (note that Ytt'{L,0) is calculated by eq. Jl4| ) with 
8 fr = 5/t' = 0). Furthermore, we see that the slopes for Ytt'(L,0) and for the scaling 



function are the same. This means that the presence of 8 fa in eq. (14) does not change the 
slope because the variance of dfx is finite. Hereafter we regard the inverse of the exponent in 
this exponential decay as the chaos length £(T, T') of the model. 
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This analysis shows that &q' Ptt' (<?') decays as exp[— qL/£(T, T')\ if q ^ 0, meaning 
that Ptt' (<?) also decays (up to power corrections) exponentially. This property corresponds 
to "strong" chaos in any reasonable classification of chaos. To obtain some insight into the 
origin of the strong chaos, let us focus on Ytt 1 (L, d = 0) which is the sum over all K L states of 
exp[-{F T (i)-F eq (T)}/T-{F T ,(i)-F ecl (T')}/T'}. (In this expression, F T (i) is the free-energy 
of state i at temperature T and F oq (T) is the equilibrium free-energy.) Now let us assume 
that among these K L states it is enough to consider just those that dominate the partition 
function at some temperature T" . Since they are dominant states, the energy, the entropy 
and the free-energy of these states are the same as the equilibrium ones at T". Therefore, 
at any temperature T m the free-energy i*r m (i) of these states are E cq {T") — T m S eq (T") (= 
F eq (T")-S eq (T")(T m -T")). On the other hand, the Taylor expansion of F Gq (T m ) around T" 
leads us to F cq (T m ) = F cq {T") - S cq (T")(T m - T") - ^C{T"){T m - T"f + 0((T m - T") 3 ), 
where C is the heat capacity. By using this for T m = T or T' , we find that the contribution 
to Y TT \L, d = 0) for such a state is exp[-{(T - T") 2 /T + (T' - T") 2 /T , }C{T")/(2T")]. For 
AT = T - T <« 1, this is maximized at T" = ^f- and we obtain 

Y TT >(L,d = 0) «exp[-AT 2 C(T)/(4T 2 )]. (15) 

In our model, C grows linearly with L, leading to an exponential decay of Ytt 1 (L, d = 0) with 
L. On the contrary, the specific heat in the low temperature phase is zero in the REM ||ll| 
and in our model without entropy jl8) and thus there is no chaos in these systems. 

Interestingly, this computation is only qualitatively correct and eq. [l5| does not give the 
exact overlap length. The reason is that we have relied on typical contributions to Ytt' while 
in fact it is dominated by rare events: a tiny fraction of the samples where the same state 
is dominant at T and T 1 determine the disorder averaged probability Ytt 1 - To calculate the 
true £(T,T'), we have to take into account such rare events; to do so, we first study how 
fluctuations grow with L at a given temperature. 

Scaling of the entropy fluctuations. In Fig. |^, we show the fluctuations of entropy, 
energy and free-energy which are defined as 

aUO)^WW-{jOW}\ (16) 
where O is quantity associated with each state, i.e., energy, free-energy and entropy, and 

ln , _ £^)exp[-X T (z)] 

{0)t = ZAV) ■ ( 73 

These quantities were calculated by recursion formulae similar to the ones for Ytt' ■ We 
clearly see that o- T (S) and c T {E) grow linearly with L, while o- T (F) converges to a finite 
value. These results show that there are a few states which have almost the same lowest free- 
energy, but whose entropies are very different from one-another. Therefore, the relative order 
of these dominant states can change by a small change of the temperature, i.e., the free-energy 
levels can cross, and these kinds of crossings generate temperature chaos in this model. Note 
that this mechanism of temperature chaos was first proposed in the scaling theories ||[l],[7j 
and its validity is also confirmed in other systems ^l) . It is also worth noticing that 
AS(i,T) = S(i) — (S)t and AE(i,T) are strongly correlated for the dominant states so that 
AS(i,T) &AE{i,T)/T because of the relation AF{i,T) = AE(i, T) — TAS(i, T). This is the 
reason why a T (S) and a T (E/T) are almost the same in Fig. ^. 

The same results hold for statc-to-state fluctuations defined as a T {0) = (C 2 )t — (C)t- 
First, a T {F) stays O(l) since a T {F) < o~ T {F). Second, a T {E) grows linearly with L because 
d- T (E) is proportional to the heat capacity. From these two results, d- T {S) « a T (E/T) cx L. 
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Fig. 2 - Fluctuations of energy, entropy and free-energy at T = 0.2 vs. generation L. The parameters 
are the same as in Fig. |l|. A function linear in L is drawn to guide the eye. 

Fig. 3 - A(T) vs. T/T c using the same parameters as Fig. [j]. A(T) is defined in eq. 

Consequences for the overlap length. - Let us estimate Ytt' (L, 0) to calculate £(T, T') -1 
(recall that Ytt'(L,0) ~ exp[—L/£(T,T')]). We denote the state with the lowest free-energy 
at T by D T . If F T > (D T ) = E(D T )-T ' S{D T ) happens to be smaller than (F) T >, the dominant 
state at T" is still Dt [Dt 1 — Dt) so that Ytt'(L, 0) for that sample is of order 1. Therefore, 

Y TT ,(L,Q) » Prob(F T ,(L> T ) < (F} T ,) 

= Prob (jT - T')AE(D T , T) < T[jF)^ - JF)^ — (T — T'){5)7]) , (18) 

where we have used AS(i,T) w AE(i,T)/T to go from the first line to the second. Now 
assume that the distribution of AE(Dt,T) is Gaussian; this seems to be plausible since 
cjt{E) is linear in L, as if there was an underlying central limit theorem process. Then we 
obtain 

Y TT ,(L,0) ~ {L/^(T,T')}-"exp[-L/£(T,T')], (19) 



£(T, T') = 



2a 2 T {E)L{T - T'f 



rp 2 



(F) T ,-(F) T -(T-T')(S)i 



(20) 



The accuracy of cq. ( |20| ) was checked by comparing £(T,T') estimated from Ytt'(L,0) and 
from eq. The result was very satisfactory, i.e., the former is 131.3 and the latter 131.8 

when the parameters are those used in Fi g, ffl . We also found similarly good accuracy for the 
other sets of (T, T') we tested. From eq. ([20D, we find 



£(T, T + AT) w A(T) 



AT 



(AT <C 1), 



A(T) = 8a^(E)C(Ty 2 T- 2 L, 



(21) 
(22) 

where again C(T) is the heat capacity ( x ). It should be noted that the chaos exponent £ 
defined via £(T,T + AT) w (AT) ^ is correctly given by the droplet theory which 

(^Rigorously speaking, eq. ( p^ ) is valid when (F)t/L = —k^T\ogZ(T)/L. This relation is justifiable in the 
low temperature phase where only a few states dominate thermodynamics of the system, and we have checked 
this numerically. 
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predicts C = !k ^r L if a x( S ) K L<is and & t( f ) k L ™ ■ (Indeed, Fig. | shows d s = 1 and 6 = 
in this model). Figure shows -A(T) of the model. We find that A(T) has a minimum around 
T w 0.2 for which the value is about 33. This tells us that temperature chaos emerges only 
at large scales, e.g., when temperature is changed by 10% {Qf- — 0.1), the chaos length is at 
least 3300. But note that eqs. ( pTj ) and ( p2] ) give us chaos volume if we consider the case d ^ 1 
since L is volume in this model. (Remember that energy and entropy are proportional to L.) 
Therefore, the minimum chaos length for Of- = 0.1 is not so large for d = 3, i.e., 3300 1 / 3 « 15. 

Conclusions. We have studied a GREM-like system with extensive entropy; it has 
strong temperature chaos, Ptt'(q) decaying as exp[—qL/£(T,T')] if T ^ T'. Entropy fluctu- 
ations from valley to valley are the central ingredients for temperature chaos, as predicted by 



the scaling (droplet) theory 



Note that the overlap length l(T,T') is proportional to 
C(T)- l (T-T')- 2 (see eqs. @J) and @) and that C(T) is typically small. If C(T) controls 
the decay of overlap probability in more general disordered systems also, then it is no surprise 
that temperature chaos is difficult to detect in simulations. Finally rejuvenation and memory 
effects observed in off-equilibrium dynamics p4| , |2"5f| are naturally interpreted by this model 
because it has both temperature chaos and a hierarchical structure. Consider for example the 
case where temperature is changed as T — > T — AT — > T. A strong rejuvenated relaxation 
will be observed at T — AT due to temperature chaos, while memory will emerge when the 
temperature is returned to T because of the hierarchical structure. 
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